To Advance AI Use in Education, Focus on Understanding Educators

A better understanding of educators’ perspectives of emerging education technology, specifically tools that incorporate AI, is essential to unlock the full potential benefits of these innovations. While prior research has primarily emphasized technological advancements, it has overlooked the profound influence of social, psychological, and cultural factors in shaping educators’ perceptions, trust, and adoption of educational technology. As increasingly powerful AI tools emerge, their design must be rooted in a deep understanding of educators' needs and perspectives. It is only with the acceptance and trust of educators that these innovative solutions can elevate learning outcomes, academic achievements, and educational equity.

Technology has become an integral part of learning and teaching practice for millions of students and working adults around the world. In the 2018 PISA survey, 71% of US students reported using laptops in classrooms (Bryant et al., 2020). Middle and high school students use tutoring systems such as Carnegie Learning for mathematics, science, and English classes, homework systems such as ASSISTments for practicing mathematics problems, and many other education technologies to create, collaborate, practice, and share their work with others. College students and most working learners use learning management systems such as Canvas that offer increasingly sophisticated content features. The COVID-19 pandemic rapidly accelerated this trend by exposing students and teachers at every level to new online learning tools and practices, which has encouraged the adoption and implementation of education technologies over the next decade (Reich & Mehta, 2020). In early 2023, the sudden popularity and wide accessibility of generative AI tools based on large language models, such as OpenAI's ChatGPT, has forced educators as well as academic policy makers to once again pay attention to how technology is used in education (Yan et al., 2023).
The pervasive use of technology in education, and the detailed information it records on student activity and performance, means that educators can get insights into students' progress and struggles. This feedback to educators is increasingly being provided by Predictive Learning Analytics (PLA) that leverage machine learning and Artificial Intelligence methods to surface predictions about which students are at risk of underperformance or dropout. For example, in 2022, 20% of all K-12 schools in the United States, which is 25k schools that serve 10 m students, use BrightBytes, one of many big data platforms with PLA capabilities that show educators risk predictions for their students (Baker et al., 2020). Likewise, many higher education institutions have adopted PLA to identify students at risk of dropping out of college. For example, the Signals system at Purdue University began back in 2006 (Arnold & Pistilli, 2012), the GPS Advising system at Georgia State University started in 2012 (Kurzweil & Wu, 2015), and OU Analyse at the Open University started in 2014 (Kuzilek et al., 2015). Since then, various commercial systems have entered the market to provide PLA-based insights to administrators and educators.
A large share of the research on education technology has focused on the technological implementation of these increasingly data-driven systems. Research communities including AIED, educational data mining, and learning analytics have been advancing the state of the art in PLA, for instance by pushing the boundaries on prediction models of student learning or affect. However, this work fails to address the issues identified by seminal studies on why classroom technology has not had the transformative impact on education and learning outcomes that some prominent scholars predicted (Christensen, Horn & Johnson, 2008). These studies do not point to any technical shortcomings as the culprit: the reason why classroom computers were Oversold & Underused, according to Cuban (2009), One Laptop Per Child … died, according to Ames (2019), and recent technological innovations such as MOOCs were a Failure to Disrupt, according to Justin Reich (2020), is not related to their technical features (e.g., their prediction accuracy, or data analytics and visu-alization capabilities). Instead, they all highlight the role of social, psychological, or cultural issues in how stakeholders relate to a given education technology, especially their perceptions, trust, and intentions towards using it. In the case of OU Analyse, a recent evaluation study showed that if educators actively use the PLA, it can lead to substantial gains for disadvantaged students; but only a fraction of educators are willing to use the system and many of them are unable to use it effectively (Herodotou et al., 2019;Hlosta et al., 2021).
These insights ought to motivate more research into the critical role of socialpsychological, cultural, and contextual factors that influence educators' adoption of technology, especially AI-powered technologies like PLA that are prone to misconceptions and fears about employment and privacy risks (Nazaretsky et al., 2022a, b). Educators' trust in and effective use of PLA are instrumental for realizing their potential benefits, and advances in explainable AI in education are beginning to offer educators new opportunities to understand the recommendations that PLA systems provide (Khosravi et al., 2022). Efforts to make AI models explainable to people matter. In fact, a recent synthesis of six major initiatives to establish ethical principles for the adoption of socially beneficial AI has identified a core set of five ethical principles for AI systems: it includes the four core bioethics principles of beneficence, non-maleficence, autonomy, and justice, plus the addition of explicability, which is a combination of intelligibility (i.e., how the PLA system works) and accountability (i.e., who is responsible for how it works) (Floridi & Cowls, 2022). Explainable AI in education is therefore more than just a useful new feature, it is an ethical design choice. And yet, it is unclear if educators' resistance to adopting PLA can be traced back to a lack of explainable AI, or if it is related to a more fundamental process, such as algorithm aversion.
Algorithm aversion is the phenomenon that characterizes people's negative attitudes towards using algorithms and it influences how they respond to AI systems in real-world environments (Dietvorst, Simmons, & Massey, 2015). People tend to trust humans more than algorithms and follow human recommendations more, especially if the task is considered subjective or it requires attention to individual uniqueness. At-risk predictions performed by PLA systems arguably require close attention to individual learner characteristics, which raises the likelihood of algorithm aversion from educators. This could lead to irrational responses, such as punishing the AI system more than a human for making the same mistake. An educator might therefore be less inclined to give a PLA system the benefit of the doubt when it errs; they would judge the system to be less competent and quickly lose trust. The following theoretical models can offer a better understanding of the influence of educators' perceptions of a PLA system on their attitudes and actions.

Technology Acceptance, Academic Resistance, and Trust
The Technology Acceptance Model (TAM) introduced by Davis (1989) helps to disentangle and understand how an individual's perceptions of a technology influence their attitudes and behavioral intentions, which in turn affect their actual use of the technology (Yi & Hwang, 2003). The model considers two kinds of perceptions as fundamental determinants of user acceptance of technology: the perceived usefulness of a technology and its perceived ease of use. TAM has been a widely used and well-performing predictive model of technology adoption in a large variety of organizational and personal contexts (Adams, Nelson & Todd, 1992;Venkatesh and Davis, 2000;Lee et al., 2003;Venkatesh and Bala, 2008). According to TAM, the perceptions that users have about a technology are not only critical determinants of technology acceptance and actual use, but those perceptions are also malleable. A technology's presentation, framing, design, marketing, among other factors, can influence perceptions of usefulness and ease of use. As one of the first models to incorporate psychological factors in technology acceptance, TAM provides a strong foundation for developing the psychology of technology in education because it clearly lays out a mechanism by which malleable perceptions affect attitudes and behavioral intentions.
While several studies have applied TAM in the context of education (e.g., Fathema et al., 2015;Park, 2009;Teo, 2009), these studies almost exclusively use structural equation modeling to apply TAM to collected survey data. Prior work on technology acceptance in education therefore does not tend to experimentally investigate changes that have a causal effect on education technology acceptance, even though TAM is a valid and predictive model of technology adoption in education (Teo, 2009). This provides a strong foundation for using TAM to develop a causal understanding of how perceptions and behavioral intentions about education technology are affected by framing, presentation, transparency, training, and context. However, TAM does not account for the strong emotional responses that new technologies, especially ones powered by AI, can trigger among educators. The Academic Resistance Model (ARM) introduced by Piderit (2000) accounts for cognitive, emotional, and intentional attitudes about an organizational change, which complements TAM. For example, Rienties (2014) found that even though most educators cognitively appreciated the usefulness of a new student evaluation system, they felt strong negative emotional attitudes and resisted the change due to anxiety and mistrust.
Educators' trust in a technology plays a critical role in the adoption of education technology (Cukurova et al., 2020). Their level of trust depends on accessible evidence that the technology is trustworthy, such as an endorsement from close colleagues, expert researchers, or a reputable organization. It also depends on educators' cognitive and emotional responses to the technology: for example, different framings of a technology can affect how much teachers trust it (Nazaretsky, Ariely et al., 2022), and different levels of algorithm transparency can affect how much students trust it (Kizilcec, 2016). This highlights the impact of how an AI system is framed to educators and how much transparency (or other types of explainability) is provided.

Beneficiary Framing, Algorithm Transparency and Literacy
If people's perceptions of a technology are critical determinants of their eventual use, then it is important to understand how their perceptions can be strategically influenced. Research on persuasion has shown that a message resonates more with an audience if it is relevant to the audience's perspective (Cialdini, 2003;Clary & Snyder, 1999;Rothman & Salovey, 1997). Educators have a unique perspective on the use of education technology and carefully consider the consequences of its use: they care about how the technology can complement their efforts but does not replace them (educator benefits), or how much it can help improve students' outcomes (student benefits). For example, in a clinical context, Grant and Hoffmann (2011) found that doctors practiced better hand hygiene if signs emphasized patient safety instead of doctor safety. While it may seem like a small difference, several studies have shown that small changes in the content of messages can produce large changes in people's mindsets and behaviors (Cialdini, 2003;Crum & Langer, 2007). In addition, how effective or competent a technology is at supporting educators or students can affect their trust and behavioral intentions according to TAM (perceived usefulness). The strong effect of framing different beneficiaries observed in prior work should motivate research in education to understand the impact of beneficiary framing of PLA on educators' trust and their behavioral intentions.
Besides beneficiary framing, the increasing sophistication of AI models in education has raised questions about explainability, algorithm transparency, and trust (Cukurova et al., 2020;Khosravi et al., 2022). While shielding the end-user from the inner workings of the technology can provide a smooth user experience, it may also raise concerns especially among expert users. Behavioral decision science research highlights the critical importance of people's expectations and algorithmic literacy for mitigating algorithm aversion (Burton et al., 2020). Educators using a PLA dashboard may want to understand how it concluded that some students are at-risk of failing a course, especially if the prediction does not align with their expectation. This may be achieved with explainable AI techniques and by improving algorithmic literacy (Long & Magerko, 2020). Most educators are not trained in AI and may experience algorithm aversion without a better understanding of how PLA works. There is at least one effort to create a professional development program for educators specifically about AI systems (Nazaretsky, Ariely et al., 2022). Even a simple explanation of an algorithm can increase algorithm transparency: learners in an online course showed more trust in a peer grading system that violated their expectations when an algorithm explanation was provided (Kizilcec, 2016), and a study of Bayesian Knowledge Tracing found that an explanation that provided algorithm transparency improved student attitudes towards the system (Williamson & Kizilcec, 2021). There is substantial room for expanding our understanding of how to design an effective intervention to increase algorithm transparency to promote educators' trust and positive behavioral intentions. Moreover, PLA literacy interventions to help educators develop a theory of mind for how PLA works, its purpose, and how to leverage effectively to augment their own decision making should also be evaluated for their effectiveness.

Focus on Understanding Educators
The successful implementation and effective use of AI systems in educational contexts is a sociotechnical challenge and therefore requires careful consideration of human factors (Buckingham Shum, Ferguson, & Martinez-Maldonado, 2019). Edu-cators play an essential role in decisions about the adoption of AI systems, but they also have limited time and flexibility to engage in new activities. Technology designers need to understand the status quo of educators' environment, workflow, schedule, and resources to identify entry points with a clear value proposition for educators' return on investment for the time it takes to integrate a new tool. For example, many educators use tools like Google Docs and have experienced the gradual introduction of AI features based on large language models (e.g., rephrasing suggestions), which are easy to integrate into daily practice. Similarly, tools that fit seamlessly into ubiquitous learning management systems to help educators' achieve effortful tasks, such as grading or summarizing student responses, are more likely to be adopted. A pragmatic view of technology adoption also highlights the role of cost and reliability of hardware and software; reliability is a particularly salient factor for any educator who has encountered issues during class time.
A better understanding of how educators perceive AI systems is necessary because educators are ultimately the final decision makers in this context. Even a perfectly reliable, accurate, and fair system is going to fail in practice if educators experience concerns about usability, errors, and algorithmic biases. Presently, we have a limited understanding of what different groups of educators think about different kinds of AIED systems, how well they understand key technologies underlying these systems, and whether they consider them helpful and trustworthy. Given the large diversity of systems, educators, and environments, this presents a large problem space for future research efforts to build a systematic understanding of the way that technology, educator, and context characteristics shape educators' beliefs and attitudes. Future work that examines these issues causally can experimentally test interventions to shape educators' beliefs and attitudes by varying the framing of AI systems, algorithm transparency and literacy, building on theoretical models of technology acceptance and academic resistance. The goal should not be to maximize educators' trust in AIED systems, which may cause overreliance and an inadvertent loss in trust, but rather to create conditions under which educators can build up trust over time through experience. Over time, educators may begin to see AIED systems as if they were competent, reliable, and resourceful members of the teaching staff.
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/ licenses/by/4.0/.
Publisher's Note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.